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ibs AUDIT SCOPE 


Following our preliminary in-depth review of all Canada Council 
programs, processes and management systems, we selected three areas for 


detailed examination: 


® The management of grants and assistance programs. The objective of 
this part of the audit was to ensure that the Canada Council is 
establishing priorities, systematically evaluating the effect of its 
sponsorship activities, and following an effective and impartial process 


for awarding grants. 


cy Financial management and control. The purpose here was to verify 
that budgetary controls are adequate and are being adhered to and 
that investment activities of the endowment fund and other funds are 


properly controlled. 


ee Management and use of human and material resources. The third 
objective was to ensure that the Council's human and material 


resources are being managed effectively and economically. 


Because the audit took place between March 1984 and January 1985, 


we examined data pertaining to the 1983-84 fiscal year. 


2. ENVIRONMENT 


Zak Mandate. Established by a 1957 Act of Parliament, the Canada 
Council's mandate is to encourage the arts in Canada. As set out in section 8(1) 
of the Canada Council Act, the Council's object is "to foster and promote the 


study and enjoyment of, and the production of works in, the arts...". 


The Council provides grants, support and services to professional 
artists and arts organizations. The Council serves as the Secretariat for the 
Canadian Commission for Unesco. Until 1978, the Council's mandate included 


encouraging the humanities and the social sciences. 


Although the Canada Council relies largely on parliamentary 
appropriations for its budget, and accounts to Parliament (through the Minister of 
Communications) for its activities, it is not subject to the Financial 
Administration Act; this leaves the Council with a large measure of flexibility and 
independence in its operations. Its accounts are audited annually by the Auditor 
General, and its financial statements are made public in an annual report to 
Parliament. The Council is also called to appear before parliamentary 
committees, among them the House of Commons Standing Committee on 


Communications and Culture. 


2.2 Organization and programs. To fulfil its mandate, the Council has 
established grants, support and service programs that fall into two categories: 
assistance to individual artists, and assistance to arts organizations. The principle 


underlying these programs is to foster and promote professional excellence in the 
arts. 


Professional Canadian artists and arts organizations can apply for 
grants in the following disciplines: dance, music, theatre, writing and publication, 
visual arts, and media arts. Artists must have completed their basic training or 
have the necessary competence in their fields to be considered professionals. 
Arts organizations must have achieved a high standard of artistic quality, 
administrative competence and financial responsibility. The Council also holds 
three annual competitions, through its Explorations program, for grants in support 
of Canadian individuals and organizations that want to undertake innovative 
artistic and cultural projects. 


During 1983-84, about 3,900 grants with a total value of $64 million 
were awarded through the Council's various programs. Individual artists received 
28.5 per cent of the grants; 71.5 per cent went to arts and arts service 
organizations. However, individual artists received only 12 per cent of the total 


granted, whereas arts organizations received 88 per cent. 


Applications from individual artists are judged by independent 
assessors, either individually or as members of juries. Assessors are themselves 
artists or arts professionals in the fields they adjudicate. There are no standing 
juries and no juries composed of Canada Council staff. The Council engages the 
services of about 800 artists and arts professionals each year to perform this role, 


at a cost of about $1.2 million. 


The evaluation process for arts organizations varies and may include 
the use of juries or reports written by independent assessors or members of the 


Disciplinary Advisory Committees described in section 2.5. 


Aceording to the Canada Council, national competitions and peer 
evaluations of applications are integral to decision making and help assure the 


integrity of the process for awarding grants. 


The Canada Council comprises four divisions: the Arts Division, the 
Unesco Division, the Administrative Division, and the Secretariat. These are 


shown in the accompanying organization chart. 


The Director and the Associate Director head a staff of about 235 
employees, many of whom are specialists in the artistic disciplines the Council 


supports. According to a booklet published recently by the Council, "Profile -- 
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The Canada Council and Its Programs", Canada Council staff choose assessors, 
organize juries, prepare grant recommendations for the board and advise it on 


policies and programs. 


2.3 Funding. When the Council was established, Parliament set up an 
endowment fund of $50 million; the income from the fund supported all programs 
until 1964. As Canada's cultural life developed, this income became insufficient, 
and in 1965 Parliament began to make appropriations to the Council. During 
fiscal 1983-84, the Council's income amounted to more than $75 million, of which 
more than $65 million, or 86 per cent, came from parliamentary appropriations. 
The other sources of Council funds are donations and bequests for special 


purposes, which totalled about $26 million. 


2.4 Council board. The Canada Council is headed by a 21-member board 
appointed by the Governor in Council for specified terms. The board meets four 
times a year -- in March, June, September and December -- to consider and 
approve grants and establish direction for Canada Council policy. Nine of its 
members sit on the Executive Committee that meets prior to each Council 
meeting and as needed. Canada Council staff then carry out their work on the 


basis of decisions made and direction given by the board. 


An Investment Committee advises the board on the management of 
the Council's endowment fund and other funds. Under section 18 of the Canada 
Council Act, the Investment Committee is composed of the Chairman of the 
Council or a representative, a member of the board designated by Council, and 


three people appointed by the Governor in Council. 


Finally, four board members make up the Audit and Evaluation 
Committee, which has responsibility for recommending the approval of the 
Council's financial statements and making recommendations to Council on all 


matters relating to audit and program evaluation. 


2.5 Disciplinary Advisory Committees. Six committees, one for each of 
the artistic disciplines supported by the Council, advise Council staff on matters 
arising within their respective disciplines. There are more than 40 members on 
these committees, which are concerned with dance, music, theatre, writing, visual 
arts, and media arts. Other advisory groups include the Touring Office Advisory 


Board and the Explorations Advisory Committee. 


3. OBSERVATIONS AND RECOMMENDATIONS 
3.1 Program Management 
3.1.1 Council board 


Membership. Board members make decisions about Canada Council 
activities and account to Parliament for those decisions. Although their decisions 
deal with cultural and artistic issues, board members also require administrative 


and financial abilities that go well beyond the artistic domain. 


If the board is to be accountable, the various areas of expertise must 
be represented at all times, whether the board is meeting in plenary session or in 
committee. To ensure that it has the expertise it requires, the board should 


define its needs and make recommendations to the Governor in Council. 


To assist in the appointment of future members, the board of the 
Canada Council should identify the knowledge and skills it needs to carry out its 


mandate and make recommendations accordingly to the Governor in Council. 


Management's Response: This has been done on numerous occasions; 
the Council will be pleased to do it again. 


OAG response: Management provided no evidence on this matter. We 
believe the board should express its needs in terms of required 
knowledge and skills. 


Meetings. All permanent Canada Council officers are permitted to 
attend and intervene at meetings of the board and its committees. Over the 
course of our audit, we observed an average of 50 employees at board meetings, 
more than double the number of board members. As well as being costly in terms 
of time, the presence of staff could inhibit open discussion among board members. 
Apart from tradition, we found no reason for such high staff attendance. We did 
discover, however, that board meetings are an important forum for 
communication and information for the Council's various divisions. But, the 
primary purpose of board meetings is clearly not to facilitate the exchange of 


information among Council staff. 


The board of the Canada Council should review its policy on 
attendance at board meetings and establish a list of staff that may be called on to 
appear as necessary. 


Management's Response: The board's advice on this subject will be 
sought, but the recommendation would seriously impair the staff's 
knowledge of the board's opinions and the board's access to the 


expertise of the staff. 


OAG response: We disagree with management's views and believe it is 


the board's prerogative to make a decision on that matter. 


Documentation. The general information provided to new board 


members does not make it easy for them to assume their new responsibilities 


quickly. 


First, the briefing book for new members does not provide adequate 
information about the Council's policies, strategies and direction or about its 
various processes. The Arts Division, the Council's key component, is not involved 
in preparing the briefing book and it does not participate in the only orientation 


session given for new members. 


Second, although the binder was revised in 1984, it contains outdated 
and redundant material. The policies described there do not always jibe either 
with the Council's internal policies manual or with reality. For example, the 
manual and the binder differ as to the policy on using juries to evaluate grant 
applications from arts organizations. New members may therefore be ill-prepared 


to fulfil their role. 


Board members receive a great deal of information before each 
meeting. Information is not always presented in a way that facilitates reading 
and preparation for decision making. Information is not organized to permit 
discussion of broad issues affecting all the artistic disciplines or the Canada 
Council's general direction, strategies or granting procedures. As might be 
expected, much of the documentation concerns recommendations on grant 
applications requiring Council approval. However, topics to be discussed across 
disciplines -- that is, independent of a discipline, a recommendation or a 
particular case that might be of interest across programs, such as overall 
management objectives, audience development or cross-disciplinary training of 


artists -- are not often included. 


The minutes of one board meeting are sent out with material prepared 
for the next meeting, a delay of two-and-a-half months. Such a delay is 


considered unacceptable by most boards of directors. 


Documentation intended for the board of the Canada Council should: 


® inform members about the Council's policies, strategies and processes; 


® be updated regularly to eliminate outdated and redundant material; 
and 


® be presented in a format that facilitates reading and assists decision 


making. 


Minutes of board meetings should be available within a reasonable 
time after each meeting. 


Management's _ Response: These recommendations will be 
implemented. 
$e1.2 Adjudication process. In 1976-77, the Office of the Auditor General 


examined the Canada Council's granting procedures as well as its internal controls 
over the administration of the grants program. The weaknesses revealed in the 
Auditor General's 1977 Report to the House of Commons were attributable largely 
to the absence of clearly defined policies and consistent procedures. The Canada 
Council took steps to correct these weaknesses by clarifying its granting policies 


and procedures. 


In the present audit we also observed that: 


= proper control over the handling of grant applications is being 


exercised from the time the application arrives to final payment; 


- methods of payment and related controls are appropriate; 
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= all recommendations concerning grants, refusals and levels of funding 


are presented to the board for final approval; and 


- the decision-making process for awarding grants does not include 


redundant activities. 


We did find, however, that 57 per cent of the value of grants given in 
1983-84 was awarded on the basis of evaluations by Canada Council staff rather 
than by juries and independent assessors. This contradicts the policy described in 
the briefing book for board members, as well as the Council's stated principle of 
peer evaluation. It is also surprising to note that the monetary value of some of 
these grants is high -- more than $1 million -- whereas the value of grants 
awarded on the basis of jury evaluations is relatively insignificant -- generally in 
the order of $7,000. 


This practice compromises the Council's own tenets -- the principles 
of integrity, impartiality and objectivity. There is also the risk that juries are 


being used ineffectively. 


If they rely on the information in their briefing books, board members 
may be unaware of the important role played by Council program staff. Asa 
result, they may unknowingly assume additional responsibility by approving 
recommendations based on evaluations conducted without the benefit of 


independent assessors. 


In view of its principles regarding the integrity of the granting 
process, the Canada Council should re-examine its methods of awarding grants as 
well as its use of juries and independent assessors. 
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Management's Response: The Council constantly re-examines its 
methods of awarding grants and its use of juries and assessors and will 


continue to do so. 


OAG response: We believe we have an interpretation problem here. 
We would like assurance that the Council will re-examine its methods 


in view of the facts we demonstrate in the previous paragraphs. 


We also observed that grant files generally do not document evaluation 
criteria, reasons for granting or refusing an application, or the level of funding 
awarded. The only material justifying grants is that presented to board members 
for their approval. But the information does not document the process of 
evaluating artistic merit, all evaluation criteria used, or how an application was 


weighed against the criteria to reach a decision about the level of funding. 


Because there is no documented evidence that each application has 


received due process, the Canada Council is constantly vulnerable to criticism. 


In the ease of applications evaluated by juries, we found no 
documentation justifying decisions, except in the case of the writing and 


publishing section. 


In the case of applications examined by Canada Council staff, files 
contained no information justifying either the grant or the funding level 
recommended on the basis of the evaluation criteria used. As a result, the 
documentation presented to the board contained nothing about the evaluation 
criteria used as a basis for recommending most of the operating grants awarded in 
the theatre, music and dance disciplines -- a total of $24 million, or 39 per cent 
of the amount of grants awarded in 1983-84. Nor was there any way of tracing 
how staff had weighed applications against criteria to arrive at a recommendation 


and funding level. 
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The Canada Council should document the evaluation criteria used to 
assess grant applications and the method by which applications are weighed 
against them and justify its decisions about awarding grants on the basis of these 


eriteria. 


Management's Response: The Council currently documents evaluation 
criteria and justifies its grant decisions on the basis of these criteria. 


OAG response: Here also, we have an interpretation problem. The 
documentation on file about criteria used is incomplete, and the 


justification of the decision based on these criteria is insufficient. 


Funding levels for operating grants depend mainly on how much an 
applicant received the previous year. The officer evaluating the application 
recommends whether the grant should increase, decrease or remain the same. 
This policy is not set out, however, in the internal policies manual, information 
booklets or briefing material for the board. Only the Estimates make any 
reference to the notion of annual subsidies. The current practice makes it appear 
that grants are awarded automatically to past recipients, leaving the Council open 


to the criticism of "historical bias" in its adjudication process. 


In addition, evaluations and decisions about grant applications take 
place during a short period of intense activity, with everyone involved carrying a 
heavy work load. In-depth evaluations of all organizations receiving grants are 
therefore difficult; but this does not make them any less necessary, given the fact 
that the awarding of these major operating grants is based on historical factors. 
In addition to annual assessments, more comprehensive evaluations could be 
conducted on a cyclical basis, say, every three to five years. Funding levels could 
be justified by starting from a zero base instead of relying on the level in previous 
years; the administrative competence and financial responsibility of the 


organization could also be examined in detail. Evaluations could then be reviewed 


- 13 - 


by Council staff and by the board any time during the year, at the same time 
allowing them to review the whole operating grants program and the criteria used 


to evaluate applications. 


The Canada Council should: 


@ review its methods of awarding operating grants; and 


* conduct in-depth evaluations of the organizations receiving operating 


grants on a multi-year cycle. 


Management's Response: The Council frequently reviews its methods 
of awarding operating grants and will continue to do so. The board 
will decide whether and in what circumstances multi-year evaluations 


would be worthwhile given their costs. 


OAG response: The Office does not consider that management and the 
board are_ systematically reviewing their awarding methods. 
Management should propose an evaluation plan, alternatives and 


estimated costs to the board so it can make decisions. 


3.1.3 Resource allocation process. Although there is a document setting out 
the six elements taken into consideration in allocating the Council's budget, there 
is no clearly defined process for. justifying how funds are divided between the 
various artistic disciplines and sections. Such a process ought to be approved by 
the board, documented, communicated throughout the Council and applied at each 


level of decision making. 


There was no formal strategic and operational planning process in 
fiscal 1983-84. Planning was limited to dividing the budget among and within the 


disciplines. 
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We did observe, however, that the Council had begun to document its 


budgetary planning cycle for 1984-85. 


Senior management at the Canada Council rationalizes its decisions 
about apportioning funds on the basis of historical and evolutionary factors. 
Pointing to the need to be responsive to the artistic milieu, management does not 
engage in formal planning. The need to respond to a changing environment does 
indeed make strategie planning difficult. But even the decision not to take an 
interventionist approach does not obviate the need for a professional organization 
to anticipate events or trends. The Canada Council has not established priorities 
or mapped out strategies by anticipating the kinds of choices it might be called on 
to make and the potential consequences, advantages and disadvantages of 
choosing one course of action or another. There is seldom debate about broad 
policy direction or the means of achieving the objects set out in the Canada 
Council Act (for example, the relative merits of direct financial assistance, 
promotional campaigns, an approach based on providing services and/or advice, 
and audience development). The present decision-making process makes it 
difficult for the Canada Council to review its strategies and to justify its requests 
for additional parliamentary appropriations. Moreover, these shortcomings leave 


the Council unprepared to deal with budget increases or cuts. 


Within the Arts Division, overall planning is hampered by the fact that 
no minimum standardization of planning activities exists. The extent of planning 
in each section depends on the experience of the manager, so that it varies 
substantially from one section to another. In the absence of standard procedures 
for developing and submitting plans and budget proposals, only some of the 


sections make detailed and explicit budget proposals and link them with their 
plans. 


The Canada Council should document how it allocates its annual 
budget within each artistic discipline and each of its services, so as to establish 
and demonstrate its priorities and the choices it has made in relation to them. 


Management's Response: A great deal of documentation on this 
subject already exists. The Council will consider how it can be 


improved. 


OAG response: We have seen no evidence of how the budget is 
allocated within each artistic discipline and each of Canada Council's 


services to demonstrate its priorities and choices. 


3.1.4 Evaluating program effectiveness. The Canada Council has developed 
a complex network for consulting with the artistic community. This means the 
Council has access to a certain type of evaluative information, but this has to do 
with evaluations of the needs and aspirations of its clientele, rather than of the 


extent to which Council programs and activities are responding to those needs. 


The term "evaluation" is used within the Council to refer to such 
activities as gathering intelligence, consulting, assessing grant applications, 


making decisions, and budget allocation. 


In the government, and within the Office of the Auditor General, 
terms such as "effectiveness measures", "evaluating effectiveness" and 
"evaluation" are reserved for activities involving the systematic and orderly 
gathering of valid and reliable qualitative and quantitative data. These empirical 
data are then used to assess the nature and extent of the intended and unintended 


effects of programs in relation to stated objectives. 


The Canada Council Act sets out the objects of the Council as being 
"to foster and promote the study and enjoyment of, and the production of works 
in, the arts...". The Act goes on to list the Council's powers and some of the 
means of achieving these objectives. The list is not directive, restrictive nor 


exhaustive. However, the Council has not translated these objectives and powers 
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into specifie corporate objectives for its programs. [n short, the Council's 
corporate objectives have not been set out in a way to give assurance that all 


managers are acting in a manner that responds to the Council's overall needs. 


Without clearly defined and approved organization-wide objectives, it 
is not surprising that in the case of specific programs, objectives are unclear or 
nonexistent. The result is that managers have no benchmarks against which to 
weigh choices or measure performance. Programs are not clearly structured and 
defined. The links that should exist between programs and activities, legislative 
intentions, and the results implied in the Council's objectives are not clearly 
articulated. As a result, senior management is in no position to be accountable 


for results to either the board or Parliament. 


To be in a position to account for its activities, the Canada Council 
should define clear links between its programs and activities and the results 
envisaged in its statement of objectives. 


Management's Response: During the audit, the audit team was 
provided with the Program Evaluation document, which relates to this 
entire section (3.1.4), describes the many methods the Council has 
evolved for evaluating programs, and explains why the government 


evaluation model proposed here is not suitable to the Council. 


During the course of the audit, the Auditor General's officials were 
also provided with a paper describing the Council's objectives, which 
are those established by Parliament in the Canada Council Act, the 
relationship between the Council's objectives and the objectives of its 
sections and programs, and descriptions of the specific objectives of 
Council sections. This paper demonstrated that Council programs and 
their objectives are clearly defined and structured. 
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Attendance at meetings of the Council's many advisory committees 
would confirm that the Council's evaluation activities provide it with 
the necessary information both on the "needs and aspirations of its 
clientele” and on "the extent to which Council programs and activities 


are responding to those needs’. 


With regard to the recommendation, successive boards of the Council 
have discussed and approved all Council programs and their objectives, 
and each board continues to review and evaluate programs. The board 


may wish to consider if further definition is required and possible. 


OAG __ response: The Office has repeatedly demonstrated to 
management that the links between programs and objectives were not 
clearly defined and articulated. Consequently, evaluation is almost 


impossible. 


Without overall objectives, the Council cannot determine which 
programs and activities should be evaluated continually and which can be 
evaluated periodically. As a result, managers do not have the perspective needed 
to evaluate the outcomes of their programs and activities and to adjust them 


periodically if necessary. 


In such a context, to give examples of the kinds of questions program 
evaluation should answer might turn out to be tendentious. However, let us 
suppose that one of the Council's objectives is to encourage the creation of 
superior works of art. Program evaluation might then look for answers to 
questions like the following: Is the Council providing too much or too little 
financial support to artists? Does the level of support foster creativity? Are the 
works of art being produced better than, as good as, or not as good as those 
produced without the Council's support? What are the socio-economic effects on 


users or audiences? 
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The Council does have a Research and Evaluation service, but the 
service does not have a mandate from senior management to evaluate Council 
programs. It conducts research and inquiries and gathers statistics. Some of the 
latter could eventually be used for program evaluation purposes if objectives were 


clearly defined and articulated. 


Given organizational structures in other agencies with similar cultural 
or social missions, one would expect to find an effectiveness evaluation function 
at the Council staffed by employees or using outside consultants. In such a case, 
the client for the evaluation is the Chief Executive Officer, and evaluation 
reports are submitted to the Audit and Evaluation Committee of the board of 


directors. 


Without precise information about the effectiveness of programs and 
activities in relation to priorities, and without information about the relative 
effectiveness of the means it has chosen, the Council cannot ensure that it is 
making the best possible decisions about its activities and the means of carrying 


them out. 
To ensure that selected activities and the means of carrying them out 
are having the desired effects, the Canada Council should: 


8 determine which of its programs and activities are amenable, in whole 


or in part, to evaluation; and 


* evaluate those programs and activities where the cost is justifiable. 


Evaluations should be done for management, but evaluation reports 
should be submitted to the Audit and Evaluation Committee of the board. 
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Management's Response: Council programs and evaluation processes have 
been developed over many years, on the advice of the Council's 
artistic advisors and successive Council boards. As the term 
"evaluation" is employed in the Council's Program Evaluation 
document, all Council programs are amenable to evaluation and all are 
continuously evaluated. For the reasons explained in that document 
and in the introductory memorandum to the Audit and Evaluation 
Committee, the type of evaluation proposed by the audit team will not 
help the Council determine if its programs are achieving their 
purposes or provide answers to the very large philosophic and aesthetic 


questions listed in the auditors’ text. 


OAG response: We do not believe that this statement reflects reality, 


especially given the definition of the word evaluation in government. 


3.135 Program co-ordination. The sections within the Arts Division operate 
with a degree of independence in day-to-day management that is necessary 
because of the peculiarities of the artistic disciplines each serves. The sections 
ean be compared to a loose federation of independent states, each with a 


different view of its role. 


Although it is difficult to compare the various disciplines, all 10 
sections of the Arts Division nonetheless perform basically similar tasks, which 
consist largely of administering arts grants. Consequently, one might expect that 
there should be a central process to co-ordinate Canada Council policy 
development and review and the choice of program instruments. This would 
improve harmonization of efforts within the various artistic disciplines and make 


it easier for clients to approach the Council. 


We looked at the existing mechanisms that could perform this 


function. The first is the monthly meeting of section heads, which serves mainly 
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as an information exchange. Policies developed by one section are sometimes 
discussed at this level, but the purpose is not to co-ordinate or harmonize policy 
and working tools across the Arts Division. The second mechanism that could 
meet the need for harmonization is meetings of the Council board. We have 
already observed that these meetings serve an information and communication 
function, but that the primary role is much different. In our view, this situation 
exists because there is no internal co-ordination mechanism. As for the "annual" 
two-day meetings away from the work place, the last took place in 1982-83; the 


minutes of that meeting make detailed analysis impossible. 


The absence of a central co-ordinating process for ensuring harmony 
among programs and articulating specific objectives leads to a fragmented 


approach to administering grants, as illustrated by the following examples: 


* Within the Arts Division, the same artistic discipline is often covered 
by more than one section. Thus, five different sections have 
assistance programs for theatre. However, there is no formal co- 
ordinating mechanism among these sections to ensure that the Canada 
Council's actions with respect to clients are in harmony and 
compatible with each other. Similarly, there is no co-ordinating 
mechanism to facilitate an approach to the Council by an artist with 


an interdisciplinary project. 


® The management of information resources intended for the Council's 
clients is not well co-ordinated. Methods vary from one section to 


another, ranging from glossy publications to no written information at 
all. 


@ The administrative aspects of implementing different types of 
programs are not co-ordinated, making the adjudication process look 
more complex than it really is. This situation makes controlling 


operations difficult as well as complicating clients’ approaches to the 
Council. 


The Canada Council should co-ordinate policy development and 
review, as well as its activities in the various artistic disciplines, and should 


facilitate its clients' approach to the Council's services. 


Management's Response: The Council agrees; it will examine how 
these activities can be improved in a useful and cost-effective 
manner. 


OAG response: The Office believes that management should give 
indications as to when and how it intends to examine co-ordination 


activities and facilitation of clients! approaches and who will do this 


work. 


See Financial Management and Control 


etek Roles and responsibilities. We detected weaknesses in financial and 
administrative control and monitoring procedures. Control is lacking because 
funetional and line responsibilities with respect to finance and administration 


have not been defined. 


As a result, both the Arts Division and the Administrative Division 
leave it to each other to take care of financial and administrative control, and 
managers! duties and accountability are not clear. Consequently, we noted a lack 
of rigour in financial management and control in 1983-84. The Council informs 


us, however, that the situation improved during 1984-85. 
We found the following symptoms of inadequately defined roles and 
responsibilities: 


@ Contrary to the role described in the Council's by-laws, the Treasurer 


had not prepared or controlled the agency's budget. In 1983-84, the 
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Treasurer issued no clear guidelines for budget preparation, control 
and monitoring. Section heads therefore prepared their budgets 
without clear guidance from the Treasurer as to timing, procedures 


and format. 


At the time of our audit, the Arts Division was exercising strict 
control over grants but was not controlling administrative 
expenditures with the same care. Nor did the Administrative Division 
have the authority to check and control these expenditures. The 
financial and administrative functions of the two Divisions were not 
co-ordinated and integrated. As a result, the operating budget was not 
properly controlled and monitored. Between 1981-82 and 1983-84, the 
Arts Division overspent several budgetary items. During the 1983-84 
audit period, the Arts Division overspent its administrative budget by 
$313,393. The overexpenditure had to be covered by dipping into the 


investment income reserve. 


The Council has stated that its administrative expenditures are low in 
relation to its total expenditures, accounting for 14.2 per cent in 
1984-85 and an average of 14.7 per cent over the past five fiscal 
years. However, these percentages do not include expenditures 
associated with the Unesco Division and some indirect costs of 
programs the Council considers to be services, among them jury and 
assessor costs, general service contracts, professional service 
contracts, the cost of producing forms and brochures and expenses 
associated with operating Stanley House. However, we consider these 
to be indirect program costs. As shown by the accompanying table, 
when these indirect costs are included, administrative costs as a 
portion of total expenditures amount to 17.1 per cent for 1983-84 and 
17.4 per cent for 1984-85. Expressed as a portion of grants awarded, 
administrative expenditures for the same two years were 20.6 per cent 
and 21 per cent respectively. In other words, the Council is spending 
21 cents to administer each dollar of support it gives to the arts. If 
the cost of running the Unesco Division is added, the figure rises to 
22.9 cents. 


TABLE * 
ADMINISTRATIVE EXPENDITURES 
(in thousands of dollars) 


% Administrative expenditures / Total expenditures 


Grants and 


Services 
Expenditures } General | 


83/84 65,505 5,611 5,472 11,083 76,588 14.5 
84/85 70,108 6,042 5,548 11,590 81,698 14.2 


% Administrative expenditues / Expenditures on Grants and Services 


Admin. 
sGoriernizy|i Cosma 


ari Expen. 


Grants and =e Fea Admin. Yen othe 
Services Expenditure Services 


Expenditures | General | Expend. 
83/84 65,505 5,611 5,472 11,083 16.9 
84/85 70,108 6,042 5,548 11,590 16.5 

% Administrative expenditures (including services) / Total expenditures 

Year Total Services Total x ae 
Expend. Admin. Total 

Expenditures Expend. 

83/84 76,588 11,083 2,000 (estim.) 

84/85 81,698 11,590 2,618 


% Administrative expenditures (including services) / Expenditures on Grants 


Services Total , 
Admin. y : 
Expenditures Expend, 
11,083 2,000 (estim.) 13,083 20.6 
11,590 2,618 14,208 21.0 


* Note: This table excludes grants, services and direct and indirect expenses associated with the Unesco 


Admin, 
Expenditure 


Admin, 
Expenditure 


Division. 
Source: Canada Council Financial Statements, 1984-85. 
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& A recent updating of the Council's signing authority delegation chart 
resulted in minor changes in the chart. Although the updating cost 
$23,400 in professional services, the chart still does not jibe with 
operational needs. There is redundancy and repetition; dollar limits on 
the signing authority of each signature on the chart are not specified, 
whether for the purchase of goods and services (the Touring Office and 
the Communications Service) or for payments to employees; and the 


various categories of expenditures are not defined clearly. 


The Canada Council should define clear roles, responsibilities and 


accountability for managers with respect to financial management. 


Management's Response: Financial management roles, responsibilities 
and accountability are under continuous review; changes will be made 


as operational needs dictate. 


OAG response: Roles are clear or they are not. They cannot be under 


continuous review. 


3.2.2 Management of Investments 


Contrary to the spirit of sections 18(2) and 19(1) of the Canada 
Council Act, the board of the Council does not take an active role in setting 
objectives for investing the Council's endowment fund and other funds, which 
amount to about $100 million and account for about 90 per cent of the Canada 
Council's total assets. Section 18(2) specifies that: 


The Investment Committee shall aid and advise the Council in making, 


managing and disposing of investments under this Act. 
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Section 19(1) reads as follows: 


The Council may, for the purposes of this Act, acquire, hold, manage 
and dispose of real and personal property, and, subject to any other 
provision of this Act relating thereto and on the advice of the 
Investment Committee, may invest in any manner it sees fit any 


money standing to the credit of the Endowment Fund... 


The minutes of Council board and Investment Committee meetings revealed that 
there is no regular review of the objectives, directions and guidelines governing 
investments. A review of this kind should take into account the economic 


situation as well as the Canada Council's current and future income needs. 


_The Canada Council should regularly review its investment objectives, 
strategy and guidelines with a view to adjusting both to economic circumstances 
and to the Council's current and future needs. 


Management's Response: The Investment Committee's annual reports 
to the Council provide a forum for discussion of investment objectives 


and strategies; the report will be expanded to better meet these goals. 


OAG response: We aim at a more active involvement from the board 
in this matter. 


Members of the Investment Committee are appointed by Order in 
Council for unlimited terms. Rotating membership on boards of directors is a 
good way to bring in new blood. The government follows this practice for other 
boards, and there is no reason why it should not also apply to the Canada Council 
Investment Committee. The literature on managing endowment funds suggests 
that committee membership terms should be staggered and of fixed duration so 
that a degree of continuity is maintained and no one member can dominate the 


committee. 
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The board of the Canada Council should recommend to the Governor in 


Council that membership terms on the Investment Committee be of fixed 


duration. 
Management's Response: The Council concurs and has_ so 


recommended by formal resolution at its March 1985 meeting. 


The board does not receive regular reports about the long-term 
consequences of its investment methods, which have been geared to producing 
revenue in the short term rather than capital growth over the longer term. For 
example, over the 27-year period between 1957 and 1984, the endowment fund 
shrank in real terms by about 85 per cent, going from $50 million to $58 


million -- the equivalent of $7.558 million in constant 1957 dollars. 


The board cannot judge whether funds are being invested effectively 
because the Investment Committee does not submit an annual written report. A 
report of this kind should include information about the status and makeup of the 
investment portfolio, its book and market values, and the level of return on 
investments for the period under review, as well any recommendations the 
committee might have as to the management of the investments. Although the 
Company responsible for day-to-day management of the funds makes an oral 
presentation to the board, it does not include all the necessary elements: book 


value, market value, and recommendations for the future. 


The Investment Committee should submit an annual report in writing 
to the board setting out the book value of each fund, its market value, and 


recommendations concerning the management of the funds invested. 


Management's Response: The Investment Committee's annual reports 
are now submitted in writing, included in the Council Minutes, and 
they describe real and comparative returns, portfolio mix, market 


conditions and prospects. 


The minutes of Investment Committee meetings do not record 
information that would enable the board to assess decisions reached. The minutes 
contain no report of the questions asked, the answers given or the discussion on 


any of the following subjects: 
- the Council's investment objectives; 
- the investments made; 


= the return and level of risk associated with investments made during 


the period; and 


= the direction given the investment management company. 


Because minutes are incomplete, the Canada Council and its board 
cannot ensure that the Investment Committee is exercising the proper control and 
following up with the investment management firm. Moreover, minutes are not 
filed with the Secretary of the Canada Council or sent to board members, leaving 
the impression that the Committee does not have the same status as other 


committees of the Canada Council. 


The Investment Committee should ensure that minutes of its meetings 


include reports on questions and discussions concerning: 


- the Council's investment objectives; 
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- investments made; 
- return on and level of risk associated with investments; and 


= guidelines to be followed by the investment management firm. 


Minutes should be filed with the Secretary of the Council and sent to 
the board of the Council. 


Management's Response: Minutes of the Investment Committee will 
be prepared to record in greater detail the Committee's deliberations 
and will be filed with the Secretary to the Council. 


OAG response: It would be appropriate for the board to receive a 
copy. 


There is no formal evaluation of investment performance or the 
quality of services provided by the management firm. It is therefore difficult to 
provide evidence of satisfactory performance. The Investment Committee could 
use the services of a company specializing in this field or rely on Council staff to 
obtain comparative information about the performance of other kinds of 


investments. 


The Investment Committee should periodically obtain information 
about the performance of other investment funds to provide a basis for comparing 


and evaluating the performance of its own investments. 


Management's Response: The Investment Committee now receives 
information comparing the Funds' performances with four market 


values, which permit performance evaluation. 


OAG response: We believe it is a good start. A control should be set 
up to ensure the evaluation will take place and will be used. 


3.3 


3.3.1 


Management and Use of Human Resources 


Allocation and use of human resources. The Canada Council is not ina 


position to justify its allocation and use of human resources; nor can it evaluate 


whether 


human resources are being allocated and used efficiently and 


economically. 


resources: 


We observed that management has no mechanism for allocating human 


The Council has no agency-wide operational plan. It has neither 
operational objectives nor performance indicators, whether for 
Divisions or for the Council as a whole. None of the sections has 
prepared a work plan to allocate human resources rationally by 
program or activity according to documented needs or expected work 


load. 

Human resources are not allocated on the basis of expected work load. 
Organizational units have no means of judging how much time is 
actually devoted to each activity. There are no work load indicators, 
such as: 


= time devoted to each activity or program; 


= number of person-years devoted to each program and activity; 


and 


= each employee's work load. 
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° Only 7 of the 54 job descriptions we examined (13 per cent) showed the 
percentage of time devoted to each task. The Council's internal 
personnel policy, however, specifies that job descriptions should 


contain this information. 


As a consequence, the Council has no satisfactory basis for monitoring 
and controlling its operational costs. For example, resources might be under-used 
or the work load might not be distributed fairly among employees or evenly over a 


given period. 


An effective method of analysing personnel needs is to apply 
performance indicators to the use of human resources. For example, to assess the 
need for support staff, a ratio of program officers to support employees could be 
used, while a ratio of supervisors to employees could be used to review the 


division of responsibilities among managers. 


Although these ratios are not absolute indicators of performance, they 
are useful tools that would allow management to improve productivity and control 


of human resources. 
The Canada Council should rationalize its process for allocating human 
resources and controlling their use by: 


e determining its real needs with respect to human resources, starting 
from a budget base of zero; 


e basing the annual allocation of human resources on operational 
objectives arising from actual needs and expected work load; and 
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8 re-examining its personnel needs through the use of work load 


indicators. 


Management's Response: These recommendations merit consideration 
and will be carefully examined. 


OAG response: The response should indicate how and when the 
examination will be done and by whom. 


Sede Work methods. The Canada Council has not examined its organization 
and work methods with a view to making optimal use of its resources. It has 
retained the organizational structure that existed before 1978, when the Council 
still. included a social sciences and humanities -component. After the 
establishment of the Social Sciences and Humanities Research Council in that 
year, the Canada Council did not deem it necessary to re-examine its organization 
and work methods to adjust them to the changed mandate. The Canada Council 
therefore cannot ensure that it is making full use of its human and material 


resources. 


A formal study of organization and methods was, however, conducted 
for the Arts Awards section of the Arts Division during 1983-84. According to 
progress reports from the section, implementing the study recommendations 
contributed significantly to improved productivity. 


Seale 


Despite the fact that the process for awarding grants is essentially a 
repetitive one, the Council has not recognized the need to establish an agency- 
wide plan for introducing office automation or for studying its needs in this area. 
We did note, however, the Canada Council's efforts with respect to introducing 
office automation. For example, in May 1984, the Council purchased 


minicomputers and started developing sectoral plans for office automation. 
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The Canada Council should regularly review its organization and work 


methods so that human and material resources are fully used. 


Management's Response: Such a study was undertaken in 1983-84 for 
one large Council section. Since the cost of a Council-wide study 


would be about $250,000, a gradual approach must be considered. 


OAG response: The role of a competent management includes the 
responsibility of reviewing its structure and work methods to optimize 
its resource utilization. A study by experts is only one of several 


possible solutions. 


The Council should establish an agency-wide plan for introducing 
office automation. 


Management's Response: Office automation plans have been instituted 
in several sections, and priorities have now been established for 


Council-wide implementation as financial resources allow. 


3.3.3 Human resource management activities. Our examination of the 
activities surrounding human resource management, including planning, staffing, 
awarding performance pay, and training, revealed a number of inadequacies, 


among them the following examples: 


be The Canada Council reacts to human resource needs as and when they 
become apparent. The creation of new positions is not justified in 
writing or based on work load, which means that human resources 


might be increased without a demonstrated need. 
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a We examined six staffing actions, three of which were conducted 
without the competition specified in the Council's internal directives. 


The reasons for deviating from the directives were not documented. 


. In principle, performance evaluation affects the awarding of bonuses 
or 2 per cent salary increases to eligible employees. In practice, there 
is no connection between evaluations and performance bonuses or 
salary increases. In April 1984, almost all eligible employees outside 
the management group received bonuses. Thus, 99 per cent of eligible 
employees, or 48 per cent of all personnel, received the bonus, which 
cost the Council $59,134. In the case of management, the 2 per cent 


performance pay increase was automatic. 


e Prior to June 1984, it was left to employees to ask to be sent on 
training courses. The new policy in effect since then is based on 
administrative procedures rather than on any kind of basic principle. 
For example, management does not analyse individual or group 
training and development needs and does not evaluate the results of 
training. The absence of a clear training and development policy 
means that there is no way to evaluate whether training funds have 


been used to best advantage. 


This lack of rigour in the management and use of human resources at 
the Canada Council is due largely to the fact that the respective roles and 


responsibilities of functional and line managers are confused. 


The Canada Council should define the roles and responsibilities of each 
of its organizational units with respect to human resource management and ensure 


that managers are aware of them. 


Management's Response: The Council concurs and will implement this 


recommendation. 
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